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Abstract 

Background: Carotid intima-media thickness (CIMT) and carotid atherosclerotic plaque (CAP) are well-known 
indicators of atherosclerosis. However, few studies have reported the value of CIMT and CAP for predicting renal 
artery stenosis (RAS). We investigated the predictive value of CIMT and CAP for RAS and propose a model for 
predicting significant RAS in patients undergoing coronary angiography (CAG). 

Methods: Consecutive patients who underwent renal angiography at the time of CAG in a single center in 201 1 
were included. RAS >50% was considered significant. Multiple logistic regression analysis with step-down variable 
selection method was used to select the best model for predicting significant RAS and bootstrap resampling was 
used to validate the best model. A scoring system for predicting significant RAS was developed by adding the 
closest integers proportional to the coefficients of the regression formula. 

Results: Significant RAS was observed in 60 of 641 patients (9.6%) who underwent CAG. Hypertension, diabetes, 
significant coronary artery disease (CAD) and chronic kidney disease (CKD) stage >3 were more prevalent in 
patients with significant RAS. Mean age, CIMT and number of anti-hypertensive medications (AHM) were higher 
and body mass index (BMI) and total cholesterol level were lower in patients with significant RAS. Multiple logistic 
regression analysis identified significant CAD (odds ratio (OR) 5.6), unilateral CAP (OR 2.6), bilateral CAP (OR 4.9), CKD 
stage >3 (OR 4.8), four or more AHM (OR 4.8), CIMT (OR 2.3), age >67 years (OR 2.3) and BMI <22 kg/m 2 (OR 2.4) as 
independent predictors of significant RAS. The scoring system for predicting significant RAS, which included these 
predictors, had a sensitivity of 83.3% and specificity of 81.6%. The predicted frequency of the scoring system agreed 
well with the observed frequency of significant RAS (coefficient of determination r 2 = 0.957). 

Conclusions: CIMT and CAP are independent predictors of significant RAS. The proposed scoring system, which 
includes CIMT and CAP, may be useful for predicting significant RAS in patients undergoing CAG. 

Keywords: Renal artery stenosis, Coronary artery disease, Carotid atherosclerotic plaque, Carotid intima-media 
thickness, Prediction model 



Background 

Renal artery stenosis (RAS) increases the risk of mortal- 
ity in patients with cardiovascular disease. RAS is associ- 
ated with the prevalence and severity of coronary artery 
disease (CAD) [1-3], and is a correctable cause of severe 
hypertension and ischemic nephropathy [4]. However, 
RAS remains under-recognized, because most patients 
with RAS have no symptoms or signs. RAS is more 
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prevalent in patients undergoing coronary angiography 
(CAG) than in the general population [5]. Performing 
renal angiography at the time of CAG can be a safe, 
cost-effective diagnostic strategy in patients at high risk 
of significant RAS [6]. However, routine evaluation for 
RAS in asymptomatic patients undergoing CAG is diffi- 
cult to justify, because of the lack of evidence for clinical 
benefits associated with renal artery intervention in 
patients with RAS. An advisory from American Heart 
Association for renal angiography at the time of CAG 
focuses on occasional cases with symptoms or clues 
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suggesting RAS [6]. The indications for investigation for 
RAS at the time of CAG in asymptomatic patients have 
not been established. 

Carotid intima-media thickness (CIMT) and carotid 
atherosclerotic plaque (CAP) are well-known indicators 
of systemic atherosclerosis [7,8]. Although several stud- 
ies have proposed models for predicting significant RAS 
using clinical parameters such as CAD, age, peripheral 
artery disease (PAD), and kidney function in patients 
undergoing CAG [9-11], no studies have reported the 
value of ultrasonography measurements of CIMT or 
CAP for predicting RAS. The aims of this study were 
to determine whether CIMT and CAP can predict 
RAS, and to propose a prediction model for RAS using 
these carotid ultrasonography measurements in patients 
undergoing CAG. 

Methods 

Study subjects and baseline data collection 

From January to December 2011, consecutive patients 
undergoing elective CAG at Hanyang University Guri 
Hospital were prospectively included in this study. Patients 
with end-stage renal disease, patients undergoing emer- 
gency percutaneous coronary intervention (PCI), and pa- 
tients with a history of renal artery intervention were 
excluded. Written informed consent was obtained from all 
patients at the time of enrollment in the study. All patients 
underwent simultaneous coronary and renal angiography. 
They also completed physical examinations including 
measurement of blood pressure, body weight and height, 
and laboratory tests including serum creatinine level, lipid 
profiles, hemoglobin Ale level and urinalysis. Body mass 
index (BMI) was calculated as (weig ht)/(height) 2 (kg/m 2 ). 
Proteinuria was defined as a random urine protein/creatin- 
ine ratio of >300 mg/g. The estimated glomerular filtration 
rate (eGFR) was calculated using the Modification of Diet 
in Renal Diseases equation. The classification of chronic 
kidney disease (CKD) stages stated in Kidney Disease Out- 
comes Quality Initiative guidelines was used to define renal 
function impairment [12]. Carotid ultrasonography was 
performed to measure CIMT and CAP. The institutional 
review board of Hanyang University Guri Hospital ap- 
proved the study design and procedures. 

Carotid ultrasonography measurements 

CIMT was measured from the lower arterial wall on longi- 
tudinal views of each distal common carotid artery during 
end-systole. The measurement of CIMT was achieved 
using automated software (Philips Healthcare, Andover, 
MA, USA). The average value of the right- and left-sided 
CIMTs was used for analysis. CAP was defined as the pres- 
ence of an area with a >50% increase in the intima-media 
thickness compared to that of the neighboring vessel wall. 
CAP was sought and identified in both common carotid 



arteries on transverse views, and was measured on longitu- 
dinal views. 

Coronary and renal angiography 

The standard approach for CAG in the hospital where 
this study was performed is femoral, and right radial 
approach is used in a minority of patients if the femoral 
approach is not available or the patients specially request 
the radial approach. The femoral artery approach was 
used for both the coronary and simultaneous renal 
angiography in this study. 5-Fr Judkins left and right 
diagnostic catheters (Cordis, Bridgewater, NJ, USA) were 
used for left and right coronary angiography, respect- 
ively. Renal angiography was performed using a 5-Fr 
Judkins right diagnostic catheter engaged in or directed 
to the renal artery ostium, with contrast medium flowing 
back from the renal artery. Both renal arteries were 
visualized in anterior-posterior projections. The degree 
of stenosis was measured using quantitative coronary 
angiography software (Siemens, Philadelphia, PA, USA). 
Significant CAD was defined as stenosis >70% in at least 
one coronary artery. Significant RAS was defined as 
stenosis >50% in at least one side. 

Statistical analysis 

The subjects were divided into two groups according 
to the presence or absence of significant RAS. The stu- 
dent's t test was used to compare continuous variables 
such as age, BMI, total cholesterol level and eGFR be- 
tween the two groups. Variables with skewed distribu- 
tions such as triglyceride level, high density lipoprotein 
(HDL) cholesterol level and CIMT were compared using 
Mann- Whitney U test. The x test was used to compare 
binary variables such as hypertension, gender, diabetes, 
smoking, significant CAD, presence of CAP and CKD 
stage >3. 

The model for predicting significant RAS was devel- 
oped as following; the best-fit model predicting for 
significant RAS was determined using multiple logistic 
regression analysis, the model was validated to identify 
the degrees of optimism and variance, and finally, a scor- 
ing system for predicting significant RAS was developed 
using the coefficients from the regression formula of the 
best-fit model. 

In order to find the best-fit model, we transformed the 
continuous variables into binary variables using the 
Youden index-J of the receiver operating characteristic 
(ROC) curve to maximize their discriminative powers of 
the best-fit model (e.g., age >67 years, BMI <22 kg/m 2 ). 
Although dichotomization of continuous variables may 
cause bias and weaken the discriminative power of the 
model, we used this method because a model using 
binary or categorical variables would be more accessible 
than a model using continuous variables. The extent of 
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CAP was defined as a 3-category variable (none, unilat- 
eral, bilateral). Then, multiple logistic regression analysis 
was performed with all binary variables available and the 
extent of CAP as a categorical variable, to reduce biases 
in variable selection. Backward variable selection using 
Wald statistics was performed to identify significant 
variables and reduce the best-fit model to acceptable 
events per variable [13]. The exclusion criterion for the 
backward selection process was set at p > 0.10, to avoid 
excluding modestly significant variables. 

Next, validation and calibration of the best-fit model 
were performed using bootstrapping methods. Bootstrap 
re-sampling is an effective technique for internal valid- 
ation and calibration of a prediction model [14]. Valid- 
ation using bootstrap re-sampling would estimate the 
likely performance of the model on a new sample of 
patients from a same clinical setting. Calibration would 
measure the degree of error between the predictive 
probability and observed probability of the model. The 
validation was performed with 1,000 re-samples drawn 
using the 0.632 bootstrap technique [15]. We programed 
the statistical software to calculate new optimal cut-off 
points for continuous variables, generate binary variables 
using the new cut-off values in each bootstrap sample 
and run a multiple logistic regression analysis using the 
backward selection method with all the new binary vari- 
ables. Bootstrap models were built from each bootstrap 
sample. The estimate of optimism in the best-fit model 
was calculated from the following formula: 



O 



M 



M 

E 

n- 1 



r n -C n 

original sample boostrap sample J 



where O is the estimate of optimism, C 0 ri g inai sample is 
the area under the curve (AUC) of the ROC curve of the 
bootstrap model in the original data, Cbootstrap sample is 
the AUC of the ROC curve of the bootstrap model in 
each bootstrap sample and M is the number of boot- 
strap samples. 

Finally, using the best-fit model, we developed a risk 
scoring system for predicting significant RAS. Using the 
following formula for logistic regression analysis of the 
best-fit model: 



In — = a + p\Xi + (5 2 X 2 + p 3 X 3 ... + P n X n 

(when coefficient p\ < |3 2 < |3 3 < ... < |3 n ) 



(1-P) 



we assigned the integer closest to pVPi as the score for 
the variable X n . Then, we summated the integers to gen- 
erate a risk score for predicting significant RAS in each 
patient, if variable X n was present in the patient. ROC 
curve analysis was performed to evaluate the discrimina- 
tive power and optimal cut-off point of the scores for 



predicting significant RAS. The goodness-of-fit of the 
risk scoring system for significant RAS was assessed 
using the Hosmer-Lemeshow test and Levenburg- 
Marquardt nonlinear regression analysis. The predicted 
probability of significant RAS was calculated from the 
following equation. 

1 

Probability = 



1 



(when L = a + coefficient [3 x (risk score) in a logistic re- 
gression analysis) 

All statistical analyses were performed with statistical 
software, R-3.0.1 for Windows. The rms package was 
used for logistic regression analysis and the ROCR, 
pROC and Epi packages were used to identify the opti- 
mal cut-off points for continuous variables and automat- 
ically transform the continuous variables into binary 
variables. 

Results 

Baseline characteristics of subjects 

Of the 1141 patients who underwent CAG during the 
period of study, 641 patients remained for the final analysis 
(Figure 1). The mean age was 61.2 ± 12.5 years and 49% of 
the patients were male. Hypertension was present in 61.0% 
of patients, diabetes in 27.8%, and smoking in 27% of the 
patients. The number of anti-hypertensive medications 
(AHM) taken by a patient was 1.6 ± 1.0. The mean serum 
creatinine was 0.87 ± 0.37 mg/dl, and CKD stage >3 was 
present in 45 patients (7%). Total cholesterol level was 
175.8 ± 41.1 mg/dl, HDL cholesterol level 47.3 ± 12.5 mg/dl 
and triglyceride level 148.6 ± 120.9 mg/dl. The mean CIMT 
was 0.89 ± 0.26 mm and CAP was present in 271 patients 



1,141 consecutive patients 
undergoing CAG 






Excluded 

• radial access (n=62) 

• on dialysis or low eGFR* (n=147) 

• emergency CAG or PCI (n=215) 








717 patients undergoing 
selective renal angiography 
simultaneously with CAG 







■ Ultrasound for CIMT and CAP 
• Height/Weight, lipid profile, etc. 






Excluded 

• Previous renal intervention (n=21) 

• Inadequately performed renal 
angiogram (n=18) 

• Missing dataf (n=37) 








641 patients analyzed 





Figure 1 Flowchart of the patients enrolled in the study. 

*eGFR <15 ml/min/1.73 m 2 t 8 cases without carotid 
ultrasonography results, 13 cases without data for height or body 
weight and 16 cases without laboratory data. CAG, coronary 
angiography; eGFR, estimated glomerular filtration rate calculated 
using the Modification of Diet in Renal Diseases equation; PCI, 
percutaneous coronary intervention; CIMT, carotid intima-media 
thickness; CA, carotid atherosclerotic plaque. 
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(42%). Significant CAD was present in 168 patients (26%) 
and significant RAS in 60 patients (9.4%). The baseline 
characteristics of patients with and without significant RAS 
are shown in Table 1. The mean age, number of AHM and 
CIMT were higher in patients with significant RAS than 
those without significant RAS, whereas BMI, total choles- 
terol level, HDL cholesterol level and eGFR were lower in 
patients with significant RAS than those without significant 
RAS. Triglyceride level was not different between the two 
groups. Hypertension, diabetes, CKD stage >3 and protein- 
uria were more prevalent in patients with significant RAS 
than those without significant RAS, whereas the propor- 
tions of males and current smokers were not different be- 
tween the two groups. Significant CAD and the presence of 
CAP were more prevalent in patients with significant RAS 
than those without significant RAS. 

Multiple logistic regression analysis for predictors of 
significant RAS 

The optimal cut-off values for continuous variables 
obtained by ROC curve analysis were CIMT 1.0 mm 
(AUC = 0.683, p = 0.002), age 67 years (AUC = 0.726, 
p <0.001), BMI 22 kg/m 2 (AUC = 0.608, p = 0.003), total 
cholesterol level 158 mg/dl (AUC = 0.618, /? = 0.002), 
HDL cholesterol level 47 mg/dl (AUC = 0.577, 
p = 0.128) and triglyceride level 119 mg/dl (AUC = 
0.537, p = 0.323). Multiple logistic regression analysis 
including with all the binary and categorical variables 



identified significant CAD (odds ratio (OR) 5.8, 
p <0.001), CKD stage >3 (OR 4.3, p = 0.002), four or 
more AHM (OR 3.6, p = 0.039), BMI >22 kg/m 2 (OR 
2.6, p = 0.014), CIMT >1.0 mm (OR 2.2, p = 0.020), uni- 
lateral CAP (OR 2.9, p = 0.039) and bilateral CAP (OR 
5.5, p <0.001) as significant predictors of significant 
RAS (Figure 2). Among the significant predictors, 
significant CAD, CKD stage >3, four or more AHM 
and bilateral CAP were stronger predictors of signifi- 
cant RAS. Age >67 years and HDL cholesterol level 
>47 mg/dl were marginally significant predictors of 
significant RAS. Total cholesterol level >158 mg/dl, 
hypertension, male gender, current smoking, diabetes, 
proteinuria and triglyceride level >119 mg/dl were not 
significant predictors of significant RAS. The average 
variable inflation factor of all the variables included in 
the multiple logistic regression analysis was 1.19 and no 
variable inflation factor of any variable exceeded 1.4. In 
multiple logistic regression analysis with backward selec- 
tion, significant CAD, unilateral or bilateral CAP, CKD 
stage >3, four or more AHM, CIMT >1.0 mm, age >67 years 
and BMI < 22 kg/m 2 remained as predictors of significant 
RAS (Table 2). 

Scoring system for significant RAS 

Using the results of the multiple logistic regression 
analysis with backward selection, we developed a scoring 
system for predicting significant RAS (Table 3). To 



Table 1 Baseline characteristics of patients undergoing coronary angiography 





Without RAS > 50% (n = 581 ) 


With RAS > 50% (n = 60) 


P-value 


Age (years) 


60.3 ±124 


70 ±9.1 


< 0.001 


Male gender, n (%) 


282 (48.5) 


32 (53.3) 


0479 


Hypertension, n (%) 


348 (59.9) 


43 (71.7) 


0.049 


Number of AHM 


1.5 ±1.1 


2.2 + 1.1 


< 0.001 


Diabetes, n (%) 


152 (26.2) 


26 (43.3) 


0.005 


Smoking, n (%) 


155 (26.7) 


1 8 (30) 


0.581 


BMI (kg/m 2 ) 


25.5 ±3.4 


24.1 ±4.3 


0.006 


Total Cholesterol (mg/dl) 


1 77.5 ± 40.9 


159.7 ±39 


0.003 


HDL Cholesterol (mg/dl)t 


46.0 (39.0, 55.0) 


42.5 (38.0, 51.5) 


0.049 


Triglyceride (mg/dl)t 


1 22.0 (89.0, 1 73.0) 


115.5 (81.3, 159.0) 


0.343 


eGFR (ml/min/1.73 m 2 ) 


11 1.5 ±35.1 


81.5 ±34.7 


< 0.001 


CKD stage >3 n (%) 


27 (4.6) 


18 (30) 


< 0.001 


Proteinuria, n (%) 


76 (13.1) 


15 (25) 


0.012 


Significant CAD*, n (%) 


124 (21.3) 


44 (73.3) 


< 0.001 


CIMT (mm)t 


0.84 (0.72, 0.98) 


1.00 (0.85, 1.15) 


< 0.001 


CAP, n (%) 


221 (38) 


50 (83.3) 


< 0.001 



Results are shown as the mean ± SD or n (%). 

The percentage inside the brackets indicates either the percentage in the group with RAS >50% or the percentage in the group without RAS >50%. 
*CAD with stenosis >70% at least one coronary artery. 

tData for skewed variables are shown as the median (1st quartile, 3rd quartile). 

RAS, renal artery stenosis; AHM, anti-hypertensive medications; BMI, body mass index; HDL, high-density lipoprotein; eGFR, estimated glomerular filtration rate; 
CKD, chronic kidney disease; CAD, coronary artery disease; CIMT, carotid intima-media thickness; CAP, the presence of carotid atherosclerotic plaque. 
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Significant CAD 
CKD stage >3 
Four or more AHM 
BMI >22 kg/m 2 
Age >67 years 
HDL cholesterol 247 mg/dl 
Total cholesterol >158 mg/dl 
Hypertension 
Male gender 
Current smoking 
Diabetes 
Proteinuria 
Triglyceride £119 mg/dl 
CIMT>1.0 mm 
Unilateral CAP 
Bilateral CAP 



Odds Ratio 

0.5 1.0 



2.0 
_l_ 



4.0 
_l 



14.0 
_J 



Figure 2 Predictors of RAS >50%. The odds ratio and CI are derived from multiple logistic regression analysis including all variables. The ruler is 
transformed into a log-scale. Triangles indicate OR, black bars 90% CI and grey bars 95% CI. Numbers inside the brackets indicate the optimal 
cut-off points for the continuous variables, derived from the Youden index-J of ROC curve analysis. Significant CAD, CKD stage >3, four or more 
AHM, CAP, CIMT >1.0 mm, BMI <22 kg/m 2 and Age >67 years are significant predictor for RAS >50%. CAD, coronary artery disease; CKD, chronic 
kidney disease; AHM, anti-hypertensive medication; BMI, body mass index; HDL, high density lipoprotein; CIMT, carotid intima-media thickness; 
CAP, carotid atherosclerotic plaque; RAS, renal artery stenosis, CI, confidence interval. 



produce the scoring system, we assigned the simplest in- 
tegers proportional to the coefficient [3 of each predictor. 
The smallest coefficient (3 was 0.831 for age >67 years 
and the largest one was 1.724 for significant CAD. The 
ratios of the coefficients of predictors to the smallest coef- 
ficient were therefore all between 1 and 2. We assigned a 
score of 1 to unilateral CAP, CIMT >1.0 mm, age >67 years 
and BMI <22 kg/m 2 , and a score of 2 to significant CAD, 
bilateral CAP, CKD stage >3 and four or more AHM. The 
total scores ranged from 0 to 11. In ROC curve analysis, 
the scoring system for significant RAS showed an AUC of 
0.896 (95% confidence interval 0.869 - 0.918), which was 
not significandy different from the AUC of the best-fit 
model (AUC = 0.898, difference = 0.002, p = 0.69 using the 

Table 2 Multiple logistic regression analysis for 
independent predictors of RAS >50% 

Predictors Coefficient p OR (95% CI) p-value 

Significant CAD* 
Extent of CAP One side 
Both sides 

CKD Stage >3 
Four or more AHM 
CIMT >1.0 mm 
Age > 67 years 
BMI < 22 kg/m 2 

Multiple logistic regression analysis was performed using a backward 
selection method. 

*Stenosis >70% in at least one coronary artery. 

OR, odds ratio; CI, confidence interval; CAD, coronary artery disease; AHM, 
antihypertensive medications; eGFR, estimated glomerular filtration rate; CIMT, 
carotid intima-media thickness; CAP, carotid atherosclerotic plaque. 



DeLong method). The scoring system showed sensitivity of 
83.3% and specificity of 81.6% at a cut-off point of >4 Using 
the same cut-off point and a prevalence of significant RAS 
9.4%, the positive predictive value was 31.8%, and the nega- 
tive predictive value was 97.7% (Figure 3). The predicted 
frequency of significant RAS using the scoring system 
agreed well with the observed frequency of significant RAS. 

Table 3 Scoring system for predicting RAS >50% 



Predictor Criteria 



Score* 



CAD 



CKD 



AHM 



BMI 



No stenosis >70% on coronary arteries 

Stenosis >70% on at least one coronary artery 

Stage <3 

Stage >3 

Less than 4 

4 or more 

>22 kg/m 2 



1.724 


5.6 (2.9-1 1 .0) 


<0.0001 




<22 kg/m 2 


1 


0.958 


2.6 (1 .0-6.8) 


0.0503 


Age 


<67 years old 


0 


1.584 


4.9 (2.1-11.1) 


0.0002 




>67 years old 


1 


1.566 


4.8 (2.1-11.0) 


0.0002 


CAP 


None 


0 


1.563 


4.8 (1.5-14.8) 


0.0069 




Present at one side 


1 


0.849 


2.3 (1 .2-4.5) 


0.0109 




Present at both sides 


2 


0.831 


2.3 (1 .2-4.6) 


0.0173 


CIMT 


<1.0 mm 


0 


0.872 


2.4 (1 .2-4.9) 


0.0174 




>1.0 mm 


1 



This scoring system should be independently validated, before used in 
clinical practice. 

*TotaI scores range from 0 to 11. 

CAD, coronary artery disease; CKD, chronic kidney disease; AHM, 
anti-hypertensive medication; BMI, body mass index; CIMT, carotid intima-media 
thickness; CAP, carotid atherosclerotic plaque. 
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Cut-off point: >4 
Sensitivity: 83.3% 
Specificity: 81.6% 
PPV*: 31.8% 
NPV*: 97.9% 
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Figure 3 Performance of the scoring system for predicting 

RAS >50%. The broken line indicates the ROC curve of the scoring 
system and the unbroken line indicates the ROC curve of the best-fit 
model. The difference between the two AUCs is 0.002, and is not 
significant (p = 0.69, DeLong method). The numbers inside the 
brackets indicate the 95% confidence intervals of the AUCs. *The 
PPV and NPV are estimated using a 9.4% prevalence of RAS >50%. 
AUC, area under curve of ROC curve; ROC, receiver operating 
characteristics; PPV, positive predictive value; NPV, negative 
predictive value. 



The Hosmer-Lemeshow test for the goodness-of-fit of the 
scoring system showed p = 0.881, and the coefficient of de- 
termination between the predicted frequency and observed 
frequency using Levenburg-Marquardt non-linear regres- 
sion analysis was R 2 = 0.957 (Table 4). 

Validation and calibration of the best-fit model 

The apparent AUC of the best-fit model derived from 
multiple logistic regression analysis with backward selec- 
tion was 0.898 (95% confidence interval 0.872-0.918). 
Validation of the best-fit model with 1000 bootstrap re- 
samples showed that the average optimism was 0.023 
and the adjusted AUC of the best-fit model was 0.875. 
The calibration plots of the best-fit model and the boot- 
strap model are shown in Figure 4. The estimates of 
both models were slightly non-linear, with the bootstrap 
model being slightly more non-linear than the best-fit 
model. Both models agreed well with the ideal line when 
the predicted probability of significant RAS was low, but 
the disagreement of the bootstrap model increased with 
increasing the predicted probability of significant RAS. 
However, the mean absolute error and 0.9 quantile abso- 
lute error of the predicted probability were 0.028 and 



0.047 respectively, suggesting only a small degree of bias 
from overfitting in the best-fit model. 

Discussion 

Main findings 

We found that the extents of CAP and CIMT were inde- 
pendent predictors of significant RAS in patients under- 
going CAG. The prevalence of significant RAS increased 
with the presence of CIMT and the extent of CAP. The 
model for predicting significant RAS which included 
significant CAD, CKD stage >3, four or more AHM, 
age >67 years, BMI <22 kg/m2, CIMT >1.0 mm, and the 
extent of CAP showed a high discrimination power and 
a small degree of bias. The predictive frequency of the 
scoring system agreed well with the observed frequency 
of significant RAS. 

Prevalence and predictors of significant RAS 

The prevalence of significant RAS was 9.4%, which is simi- 
lar to the findings of previous studies [3,5,9,11,16,17]. How- 
ever, the actual prevalence of significant RAS may be 
higher, because we excluded patients undergoing emer- 
gency PCI and those with a history of renal artery 
intervention. 

Hypertension and diabetes, classic risk factors for athero- 
sclerosis, were not strongly associated with significant RAS 
in this study because they were already reflected by other 
predictors, namely significant CAD, CIMT, extent of CAP, 
old age, four or more AHM. The high prevalence of hyper- 
tension among patients undergoing CAG may also have 
contributed to the weak association between significant 
RAS and hypertension. Instead, four or more AHM indicat- 
ing severe, uncontrolled hypertension was a strong pre- 
dictor of significant RAS. The BMI and total cholesterol 
levels were paradoxically lower in patients with significant 
RAS than those without significant RAS. This may be be- 
cause the BMI and total cholesterol level also partially re- 
flect muscle mass and nutritional status [18,19]. Patients 
with significant RAS often have multiple co-morbidities 
and poor general health. Prezewlocki et al. [10] also re- 
ported that BMI <25 kg/m 2 was a predictor of significant 
RAS. 

Carotid ultrasonography parameters, such as CAP and 
CIMT, are known as the predictors of cardiovascular 
disease [7,8,20], and the relationship between RAS and 
systemic atherosclerosis is well established [16]. The associ- 
ation between CIMT and RAS, however, has only been re- 
ported in a few studies [21,22], and the value of the extent 
of CAP for predicting RAS has not been reported until 
now. This is the first study using a multiple logistic regres- 
sion model to report CIMT and the extent of CAP mea- 
sured by carotid ultrasonography as independent predictors 
of significant RAS in patients undergoing CAG. 
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Table 4 Observed and predicted frequencies of RAS > 50% using the scoring system 



Without RAS >50% With RAS >50% 



Score 


Numbers of patients (n) 


Observed frequency (n) 


Predicted frequency (n) 


Observed frequency (n) 


Predicted frequency* (n) 


0 


156 


155 


155.12 


1 


0.88 


I 


145 


144 


144.17 


1 


1.83 


2 


106 


104 


103.01 


2 


2.99 


3 


// 


71 


72.26 


6 


4.74 


A 


56 


48 


48.75 


8 


7.24 


5 


45 


34 


33.68 


11 


11.32 


6 


28 


14 


15.90 


14 


12.10 


/ 


21 


9 


7.71 


12 


13.29 


8 


/ 


2 


1.43 


5 


5.57 


9 


0 


0 


0 


0 


0 


10 


0 


0 


0 


0 


0 


11 


0 


0 


0 


0 


0 



•(Number of patients) x 1/[1 + Exp(-L)], when L = -5.1 75 + 0.81 7 x (score). 
p = 0.881, Hosmer-Lemeshow test. 

Coefficient of determination R 2 = 0.957 for agreement with the observed frequency, Levenburg-Marquardt non-linear regression method. 




0.0 0.2 0.4 0.6 0.8 



Predicted probability of RAS >50% 

Figure 4 Calibration plot for the model for predicting RAS >50%. 

The plot illustrates the accuracy of the best-fit model ("Apparent") 
and the bootstrap model ("Bias-corrected") for predicting RAS 
>50%. Locally weighted scatterplot smoothing was used to 
illustrate the relationships of the two models with the ideal line. 
Both plots are slightly non-linear and agree well in low predicted 
probabilities of RAS >50%, but the disagreement between the two 
plots grows with the predicted probability of RAS >50%. The 0.9 
quantile absolute error of the predicted probability is 0.047. The 
black dots illustrate the relationship between the predicted 
probability and observed probability of the scoring system for 
predicting RAS >50% in the original data set. The r 2 of linear 
regression of the dots is 0.982. 



Model for predicting RAS 

RAS contributes to severe but correctable, hypertension 
and to left ventricular hypertrophy. Although RAS is an 
independent risk factor for cardiovascular mortality, 
screening for RAS in asymptomatic patients is currently 
controversial, because none of the large randomized tri- 
als to date have shown clinical benefits associated with 
renal artery stenting compared with medical therapy in 
patients with RAS [23,24]. Routine "drive-by" renal angi- 
ography in all patients undergoing elective CAG is espe- 
cially difficult to support because of the lack of evidence 
of benefit and the low prevalence of RAS. A distinction 
should be made, however, between identifying patients 
with significant RAS and selecting patients for renal ar- 
tery intervention. It is important to identify patients with 
significant RAS who are at increased risk of cardiovascu- 
lar events and require close observation [25]. RAS is an 
independent predictor of mortality in patients with car- 
diovascular disease [1,2,25]. From this point of view, it 
may be useful to determine indications for performing 
renal angiography at the time of CAG in selected pa- 
tients undergoing CAG. 

The American Heart Association advises renal angiog- 
raphy at the time of CAG in patient with multi-vessel 
CAD or PAD [6]. The reported prevalence of significant 
RAS ranges from 10% to 36% in patients with triple- 
vessel CAD [3,9-11,22] and from 21% to 55% in patients 
with PAD [9,11,25]. Models for predicting significant 
RAS that include multiple clinical predictors may enable 
more accurate selection of patients for renal angiog- 
raphy. Several studies have proposed prediction models 
for significant RAS in patients undergoing CAG [9-11]. 
Clinical predictors including age, hypertension, BMI, 
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number of AHM, CAD, PAD, serum creatinine level and 
eGFR have been used in these models. However, these 
prediction models were either too complicated or did 
not provide a sufficiently predictive performance to be 
applied to clinical practice. 

Duplex ultrasonography is a safe and acute non-invasive 
screening tool for RAS. The sensitivity and specificity of 
duplex ultrasonography were already 92.5% and 95.7%, 
respectively, in a 1997 study of patients suspected to have 
RAS [26]. Duplex ultrasonography will be a superior 
screening modality to any clinical predictors or scoring 
methods, if a patient is suspected to have RAS. Neverthe- 
less, a scoring system for predicting RAS can still be a 
useful tool for clinicians to estimate the risk of RAS in 
asymptomatic patients undergoing CAG. 

Carotid ultrasonography is a simple, non-invasive tool 
frequendy used in current clinical practice to evaluate car- 
diovascular risk [27] . Our scoring system for predicting sig- 
nificant RAS included CIMT and CAP measured by carotid 
ultrasonography, and showed better sensitivity and specifi- 
city than scoring systems in the previous studies. The high 
negative predictive value and moderate positive predictive 
value may enable use of the scoring system as a quick 
decision-making tool for a physician to undertake a definite 
diagnostic testing for significant RAS. The goodness-of-fit 
between the predicted and observed frequency of signifi- 
cant RAS was high in our model. The scoring system was 
also made as simple as possible, so that it could easily be 
applied to clinical practice. All the items of the scoring sys- 
tem were assigned in the simplest integers, 1 or 2, and the 
score range was 0 toll. 

We also validated our model with bootstrap re-sampling 
technique. Validation and calibration procedures are re- 
quired for a prediction model to be useful in clinical prac- 
tice. Przewlocki et al. [10] performed validation of their 
model by random splitting of the data. However, other pre- 
vious studies that reported models for predicting RAS did 
not perform validation procedures. Bootstrap re-sampling 
is a more effective technique for validating a prediction 
model than data splitting [14], and the 0.632 bootstrap 
technique used in our validation procedures is a variant 
bootstrap method that can provide very similar validation 
to that obtained using an independent data set [26] . A small 
degree of optimism was observed, and the disagreement in 
validation and calibration between the predicted probability 
and actual probability increased with increasing predicted 
probability. However, the bias from overfitting was accept- 
able in this study. We believe that our prediction model 
can be a useful tool for evaluating the risk of significant 
RAS in patients undergoing CAG. 

Limitations 

Our study was performed in a single center and may 
therefore contain referral bias. Although the patients were 



included consecutively in the study, the exclusion of 
patients because of radial approach, emergency PCI, end- 
stage renal disease, previous renal artery intervention, or in- 
adequately performed renal angiography may have affected 
the recorded prevalence of significant RAS. Carotid ultra- 
sonography is a simple and non-invasive tool for assessing 
the extent of atherosclerotic diseases, but, is still not per- 
formed routinely in patients undergoing CAG. Although 
the scoring system can be used for pre-procedural estima- 
tion of the probability of RAS, the indications for renal 
artery intervention in asymptomatic patients still need to 
be established for the prediction model to be relevant to 
improving clinical outcomes. Finally, although we validated 
our model, internally with bootstrap re-sampling technique, 
the proposed scoring system should be externally validated 
before being used in routine clinical practice. 

Conclusions 

CIMT and CAP measured by carotid ultrasonography 
are independent predictors of significant RAS in patients 
undergoing CAG. The proposed model for predicting 
significant RAS which includes the carotid ultrasonog- 
raphy parameters and other independent predictors 
showed good diagnostic performance and only a small 
amount of bias, and may be a useful tool for deciding 
whether a definite diagnostic procedure is needed at the 
time of CAG. Further investigation is needed for inde- 
pendent validation of our model. 
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